Panache: A Parallel File System Cache for Global File Access
نویسندگان
چکیده
Cloud computing promises large-scale and seamless access to vast quantities of data across the globe. Applications will demand the reliability, consistency, and performance of a traditional cluster file system regardless of the physical distance between data centers. Panache is a scalable, high-performance, clustered file system cache for parallel data-intensive applications that require wide area file access. Panache is the first file system cache to exploit parallelism in every aspect of its design—parallel applications can access and update the cache from multiple nodes while data and metadata is pulled into and pushed out of the cache in parallel. Data is cached and updated using pNFS, which performs parallel I/O between clients and servers, eliminating the single-server bottleneck of vanilla client-server file access protocols. Furthermore, Panache shields applications from fluctuating WAN latencies and outages and is easy to deploy as it relies on open standards for highperformancefile serving and does not require any proprietary hardware or software to be installed at the remote cluster. In this paper, we present the overall design and implementation of Panache and evaluate its key features with multiple workloads across local and wide area networks.
منابع مشابه
Design and Implementation of Metadata Cache Management Strategy for the Distributed File System
Caching strategies and the resulting cache coherence control technique have become the key techniques for the system development. Based on the study of the cache technology of the home and abroad distributed file systems, and combined with the design requirements and characteristics for our multi-user parallel file system Cappella, this paper proposes a new meta-data cache management strategy. ...
متن کاملDesign of an I/O Balancing File System on Web Server Clusters
The paper presents the design of an I/O balancing file system on Web server clusters. High-speed networks allow machines to access remote data nearly as quickly as they can access local data. This trend motivates the introduction of I/O balancing mechanism into cluster file systems. Two effective approaches are issued in the paper: file migration and unique cache. The former is to migrate the f...
متن کاملPaca: a Distributed File System Cache for Parallel Machines. Performance under Unix-like Workload
Parallel computers have a great computing power while I/O performance is far behind and it is, very often, the machine bottleneck. In this paper we tackle this problem presenting PACA, a cache directed le system aimed at parallel machines which run both Unix-like and parallel applications. PACA is a spe-ciic cooperative caching mechanism that de-nes a parallel global cache from all nodes local ...
متن کاملMulti Level Caching and Anticipated Parallel Processing-Based Algorithm for Improving the Performance of the Distributed File System
Large amount of data is getting generated due to the extensive use of web applications by billions of users around the globe. The organizations which has deployed web applications are pondering over solutions for scalable storage and faster access of large data. Distributed file systems (DFSs) have been emerged as efficient storage solutions so that the data can be stored and accessed efficient...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2010